2021-04-23 03:53

Contents of config.yml

#shrinkBatchSources: 30
batchSamples: 3
warmupIterations: 3
benchmarkIterations: 3
jsglr2variants:
  - standard
  - elkhound
  - incremental
languages:
  - id: java
    name: Java
    extension: java
    parseTable:
      repo: https://github.com/metaborg/java-front.git
      subDir: lang.java
    sources:
      incremental:
        - id: apache-commons-lang-stringutils
          name: StringUtils
          repo: https://github.com/apache/commons-lang.git
          files:
            - src/main/java/org/apache/commons/lang3/StringUtils.java
          versions: 3 # 16
        - id: gson
          repo: https://github.com/google/gson.git
          versions: 3 # 16
        - id: slf4j
          repo: https://github.com/qos-ch/slf4j.git
          versions: 3 # 16
  - id: webdsl
    name: WebDSL
    extension: app
    parseTable:
      file: ../parsetables/WebDSL.tbl
      subDir: webdslstatix
    sources:
      incremental:
        - id: webdsl-yellowgrass-incremental
          name: YellowGrass
          repo: https://github.com/webdsl/yellowgrass
          fetchOptions:
            - '--depth=200'
          versions: 3 # 16
        - id: webdsl-elib-utils
          name: elib-utils
          repo: https://github.com/webdsl/elib-utils
          versions: 3 # 16
  - id: sdf3
    name: SDF3
    extension: sdf3
    parseTable:
      repo: https://github.com/metaborg/sdf.git
      subDir: org.metaborg.meta.lang.template
    sources:
      incremental:
        - id: nabl
          name: NaBL
          repo: https://github.com/metaborg/nabl
          versions: 3 # 16
        - id: dynsem
          name: DynSem
          repo: https://github.com/metaborg/dynsem
          versions: 3 # 16
        - id: flowspec
          name: FlowSpec
          repo: https://github.com/metaborg/flowspec
          versions: 3 # 16
        - id: webdsl
          name: WebDSL
          repo: https://github.com/webdsl/webdsl-statix.git
          versions: 3 # 16
        - id: java
          name: Java
          repo: https://github.com/metaborg/java-front.git
          versions: 3 # 16

Iterations: 3/3

Spoofax version: master
JSGLR version: reuse-mess
SDF version: develop/jsglr2

Language	Parse Nodes			Character Nodes Count
Language	Count	Ambiguous	Irreusable	Character Nodes Count
Average	595575	0.36%	33.17%	332991
Java	1443909	0.00%	27.55%	849158
WebDSL	246893	0.06%	24.99%	99773
SDF3	95922	1.01%	46.97%	50041

Language	Parse Nodes			Shift		Breakdown
Language	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	127263	85.92%	13.34%	1609	43780	14.02%	56.52%	0.00%	3.81%	0.08%
Java	351714	70.09%	29.11%	3747	126873	29.85%	37.55%	0.00%	0.42%	0.09%
WebDSL	10137	98.12%	1.50%	427	1525	1.76%	65.60%	0.00%	8.27%	0.12%
SDF3	19938	89.55%	9.43%	653	2941	10.45%	66.40%	0.00%	2.74%	0.02%

Per Language

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	1443909	0.00%	27.55%	849158
StringUtils	571226	0.00%	21.57%	396935
gson	2305879	0.00%	33.46%	1267956
slf4j	1454623	0.00%	27.62%	882583

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	351714	70.09%	29.11%	3747	126873	29.85%	37.55%	0.00%	0.42%	0.09%
StringUtils	959846	12.15%	85.63%	9144	362064	87.70%	24.39%	0.00%	0.14%	0.05%
gson	30203	99.52%	0.44%	676	6972	0.48%	42.92%	0.00%	0.36%	0.15%
slf4j	65093	98.60%	1.26%	1421	11584	1.36%	45.33%	0.00%	0.76%	0.06%

Sources

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	571226	0 (0.00%)	123189 (21.57%)	396935

0	571555	0 (0.00%)	123172 (21.55%)	397077
1	570897	0 (0.00%)	123206 (21.58%)	396792
2	570913	0 (0.00%)	123172 (21.57%)	396796

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	959846	69418 (12.15%)	489137 (85.63%)	9144	362064	500974 (87.70%)	122165 (24.39%)	0 (0.00%)	706 (0.14%)	260 (0.05%)
-> 0	1050282			0	397078
0 -> 1	959464	69384 (12.14%)	488525 (85.47%)	9150	362055	500603 (87.59%)	121793 (24.33%)	0 (0.00%)	1135 (0.23%)	265 (0.05%)
1 -> 2	960228	69451 (12.17%)	489748 (85.79%)	9138	362073	501344 (87.82%)	122536 (24.44%)	0 (0.00%)	277 (0.06%)	254 (0.05%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	2305879	0 (0.00%)	771515 (33.46%)	1267956

0	2305749	0 (0.00%)	771476 (33.46%)	1267874
1	2306009	0 (0.00%)	771553 (33.46%)	1268038
2	2306176	0 (0.00%)	771609 (33.46%)	1268122

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	30203	2294820 (99.52%)	10127 (0.44%)	676	6972	11061 (0.48%)	4254 (42.92%)	0 (0.00%)	36 (0.36%)	19 (0.15%)
-> 0	6379840			0	1268079
0 -> 1	35284	2290689 (99.35%)	14073 (0.61%)	629	10494	15062 (0.65%)	4606 (30.58%)	0 (0.00%)	37 (0.25%)	32 (0.21%)
1 -> 2	25121	2298951 (99.69%)	6181 (0.27%)	723	3449	7060 (0.31%)	3901 (55.25%)	0 (0.00%)	34 (0.48%)	6 (0.08%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	1454623	0 (0.00%)	401737 (27.62%)	882583

0	1453298	0 (0.00%)	401497 (27.63%)	881618
1	1455947	0 (0.00%)	401976 (27.61%)	883547
2	1455688	0 (0.00%)	401844 (27.61%)	883490

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	65093	1434282 (98.60%)	18283 (1.26%)	1421	11584	19809 (1.36%)	8980 (45.33%)	0 (0.00%)	151 (0.76%)	12 (0.06%)
-> 0	3421848			0	881857
0 -> 1	66460	1433399 (98.63%)	18048 (1.24%)	1395	12345	19515 (1.34%)	8859 (45.40%)	0 (0.00%)	91 (0.47%)	10 (0.05%)
1 -> 2	63725	1435165 (98.57%)	18518 (1.27%)	1447	10822	20102 (1.38%)	9101 (45.27%)	0 (0.00%)	211 (1.05%)	13 (0.06%)

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	246893	0.06%	24.99%	99773
YellowGrass	391904	0.07%	25.10%	159394
elib-utils	101881	0.05%	24.88%	40151

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	10137	98.12%	1.50%	427	1525	1.76%	65.60%	0.00%	8.27%	0.12%
YellowGrass	14082	98.66%	1.15%	203	1840	1.25%	89.63%	0.00%	4.18%	0.00%
elib-utils	6191	97.58%	1.85%	651	1210	2.27%	41.58%	0.00%	12.36%	0.23%

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	391904	272 (0.07%)	98377 (25.10%)	159394

0	392319	272 (0.07%)	98365 (25.07%)	159532
1	391488	272 (0.07%)	98389 (25.13%)	159255
2	391392	272 (0.07%)	98390 (25.14%)	159227

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	14082	386654 (98.66%)	4508 (1.15%)	203	1840	4886 (1.25%)	4427 (89.63%)	0 (0.00%)	217 (4.18%)	0 (0.00%)
-> 0	684883			0	159584
0 -> 1	19833	384708 (98.06%)	6483 (1.65%)	140	2604	7051 (1.80%)	6475 (91.83%)	0 (0.00%)	335 (4.75%)	0 (0.00%)
1 -> 2	8331	388600 (99.26%)	2533 (0.65%)	266	1075	2721 (0.70%)	2379 (87.43%)	0 (0.00%)	98 (3.60%)	0 (0.00%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	101881	48 (0.05%)	25351 (24.88%)	40151

0	101002	48 (0.05%)	25179 (24.93%)	39821
1	102759	48 (0.05%)	25523 (24.84%)	40480
2	103029	48 (0.05%)	25611 (24.86%)	40589

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	6191	99423 (97.58%)	1881 (1.85%)	651	1210	2305 (2.27%)	902 (41.58%)	0 (0.00%)	306 (12.36%)	5 (0.23%)
-> 0	181055			0	39838
0 -> 1	6684	98052 (97.08%)	2060 (2.04%)	742	1423	2671 (2.64%)	698 (26.13%)	0 (0.00%)	484 (18.12%)	0 (0.00%)
1 -> 2	5697	100794 (98.09%)	1701 (1.66%)	559	997	1938 (1.89%)	1105 (57.02%)	0 (0.00%)	128 (6.60%)	9 (0.46%)

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	95922	1.01%	46.97%	50041
NaBL	194260	0.88%	45.68%	98548
DynSem	21531	1.22%	45.15%	10138
FlowSpec	27218	1.06%	52.78%	13760
WebDSL	162747	1.14%	44.98%	86109
Java	73854	0.76%	46.28%	41650

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	19938	89.55%	9.43%	653	2941	10.45%	66.40%	0.00%	2.74%	0.02%
NaBL	30332	94.99%	4.72%	800	4549	5.01%	66.18%	0.00%	1.21%	0.12%
DynSem	20771	70.69%	26.29%	858	2583	29.31%	64.04%	0.00%	0.80%	0.00%
FlowSpec	11660	89.82%	8.98%	326	1546	10.16%	75.67%	0.00%	3.06%	0.00%
WebDSL	34640	93.16%	6.29%	1166	5667	6.84%	63.78%	0.00%	0.59%	0.00%
Java	2287	99.08%	0.85%	114	362	0.92%	62.34%	0.00%	8.02%	0.00%

Sources

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	194260	1707 (0.88%)	88736 (45.68%)	98548

0	194255	1707 (0.88%)	88733 (45.68%)	98540
1	194265	1707 (0.88%)	88738 (45.68%)	98556
2	194617	1717 (0.88%)	88870 (45.66%)	98731

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	30332	184522 (94.99%)	9173 (4.72%)	800	4549	9740 (5.01%)	6994 (66.18%)	0 (0.00%)	37 (1.21%)	6 (0.12%)
-> 0	521447			0	98667
0 -> 1	55056	176275 (90.74%)	16993 (8.75%)	1339	8177	17982 (9.26%)	13095 (72.82%)	0 (0.00%)	40 (0.22%)	8 (0.04%)
1 -> 2	5608	192769 (99.23%)	1353 (0.70%)	261	921	1498 (0.77%)	892 (59.55%)	0 (0.00%)	33 (2.20%)	3 (0.20%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	21531	263 (1.22%)	9721 (45.15%)	10138

0	21312	259 (1.22%)	9621 (45.14%)	10027
1	21750	267 (1.23%)	9820 (45.15%)	10248
2	21750	267 (1.23%)	9820 (45.15%)	10248

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	20771	15219 (70.69%)	5661 (26.29%)	858	2583	6311 (29.31%)	4042 (64.04%)	0 (0.00%)	50 (0.80%)	0 (0.00%)
-> 0	56142			0	10031
0 -> 1	20978	15119 (70.94%)	5537 (25.98%)	847	2645	6197 (29.08%)	3961 (63.92%)	0 (0.00%)	71 (1.15%)	0 (0.00%)
1 -> 2	20564	15319 (70.43%)	5784 (26.59%)	868	2521	6424 (29.54%)	4122 (64.17%)	0 (0.00%)	29 (0.45%)	0 (0.00%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	27218	289 (1.06%)	14365 (52.78%)	13760

0	26820	283 (1.06%)	14137 (52.71%)	13540
1	27616	295 (1.07%)	14593 (52.84%)	13980
2	28023	295 (1.05%)	14744 (52.61%)	14154

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	11660	24426 (89.82%)	2464 (8.98%)	326	1546	2787 (10.16%)	2018 (75.67%)	0 (0.00%)	58 (3.06%)	0 (0.00%)
-> 0	77718			0	13560
0 -> 1	7498	25529 (95.19%)	1172 (4.37%)	108	1109	1303 (4.86%)	1066 (81.81%)	0 (0.00%)	64 (4.91%)	0 (0.00%)
1 -> 2	15821	23323 (84.45%)	3755 (13.60%)	544	1983	4270 (15.46%)	2969 (69.53%)	0 (0.00%)	52 (1.22%)	0 (0.00%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	162747	1861 (1.14%)	73207 (44.98%)	86109

0	162615	1857 (1.14%)	73157 (44.99%)	86050
1	162878	1864 (1.14%)	73256 (44.98%)	86167
2	162841	1864 (1.14%)	73229 (44.97%)	86154

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	34640	151600 (93.16%)	10245 (6.29%)	1166	5667	11134 (6.84%)	7033 (63.78%)	0 (0.00%)	37 (0.59%)	0 (0.00%)
-> 0	423976			0	86076
0 -> 1	8331	160060 (98.43%)	2321 (1.43%)	319	1420	2557 (1.57%)	1651 (64.57%)	0 (0.00%)	24 (0.94%)	0 (0.00%)
1 -> 2	60948	143140 (87.88%)	18168 (11.15%)	2013	9913	19710 (12.10%)	12414 (62.98%)	0 (0.00%)	49 (0.25%)	0 (0.00%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	73854	559 (0.76%)	34177 (46.28%)	41650

0	73857	559 (0.76%)	34178 (46.28%)	41651
1	73851	559 (0.76%)	34176 (46.28%)	41649
2	73852	559 (0.76%)	34178 (46.28%)	41649

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	2287	73175 (99.08%)	626 (0.85%)	114	362	679 (0.92%)	469 (62.34%)	0 (0.00%)	40 (8.02%)	0 (0.00%)
-> 0	197675			0	41712
0 -> 1	3545	72892 (98.69%)	872 (1.18%)	132	508	961 (1.30%)	754 (78.46%)	0 (0.00%)	28 (2.91%)	0 (0.00%)
1 -> 2	1028	73457 (99.47%)	379 (0.51%)	95	216	396 (0.54%)	183 (46.21%)	0 (0.00%)	52 (13.13%)	0 (0.00%)